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ABSTRACT 



A video conference system, which is arranged to conduct a 
video conference among multiple points by communicating 
at least images and sounds among the multiple points, 
includes a monitor for displaying moving images respec- 
tively obtained from a plurality of connected stations on 
individual window screens, a pointing device for selecting 
one station from among the plurality of connected stations 
which respectively correspond to the moving images dis- 
played on the individual window screens of the monitor, and 
a controller for enabling operating control of a camera 
disposed in a selected station. 

30 Claims, 7 Drawing Sheets 
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1 2 
VIDEO CONFERENCE SYSTEM control of a camera disposed in the station selected by the 

station selecting means. 

This is a continuation application under 37 CFR 1.62 of In accordance with another aspect of the present 
prior application Ser. No. 08/289,261, filed Aug. 11, 1994. invention, there is provided a video conference system 

5 arranged to conduct a video conference among multiple 
BACKGROUND OF THE INVENTION p0 ^ is by communicating at least images and sounds among 

1 Field of the Invention * e multiple points, which system comprises display means 

The present invention relates to a video conference sys- f « ^f^* movin 8 JTf* JSftSS! » 

tem wWch enables a video conference to be held among 10 * CO,a f? stab0DS . 0D 

. & 10 screens, station selecting means for selectmg one station 

mump e pom . from among the plurality of connected stations which 

2. Description of the Related Art respectively correspond to the moving images displayed on 

In recent years, digital communications lines have been the individual window screens of the display means, and 

beginning to spread, and video telephone/video conference mode selecting means for selecting one mode from among 

systems using digital networks have received attention. The 15 a first mode in which moving images respectively transmit- 

spread of communications systems requires standardization. ted from the plurality of connected stations are displayed, in 

There are five recommendations concerning images and a time-division manner, a second mode in which only an 

sounds. H.221 defines the frame structures of channels of 64 image transmitted from a station in which speaking is 

Kbits/s to 1,920 Kbits/s, H.230 defines control signals and occurring is displayed as a moving image, while images 

indicating signals as to frame synchronization, and H.242 20 transmitted from the others of the plurality of connected 

defines interconnection procedures of up to 2 Mbits/s. H.261 stations are respectively displayed as still images, and a third 

defines a video coding system of Px64 Kbits/s, and H.320 mode in which only an image transmitted from a station 

defines communication system arrangements for sounds and selected from among the plurality of connected stations is 

images. displayed as a moving image. 

In multiple-points interconnection video conferences, it 25 The above and other objects, features and advantages of 

has presently been common practice to adopt star connection the present invention will become apparent from the fol- 

systems, such as that shown in FIG. 1. There are a number lowing detailed description of a preferred embodiment of the 

of methods for displaying moving images obtained from present invention, taken in conjunction with the accompa- 

remote stations, for example, a method of switching images nying drawings. 

obtained from a plurality of stations in a time-division 30 

manner, a method of displaying an image obtained from a BRIEF DESCRIPTION OF THE DRAWINGS 

station in which speaking is occurring, and a method of FIG. 1 is an explanatory view of a star connection for a 

setting a plurality of windows and assigning moving images multiple-points interconnection video conference; 

obtained from remote stations to the respective windows in ~1 _ . . . ... _ . . tt 

a fixed manner 35 FIG- 2 is a schematic block diagram showing the arrange- 

. t . ment of an embodiment of the present invention; 

However, the method of switching images obtained from , . A 

a plurality of stations in a time-mvision T manner and the ™J- 3 « a ^ em f C bloC * * howmg ^ C ° n " 

method of displaying an image obtained from a station in on o a y , 

which speaking is occurring have the problem that it is F 10 * 4 & a schematic block diagram showing the con- 
impossible to operate (for example, pan, tilt or zoom) a 40 struction of a multiple-points interconnection control device 
camera disposed in a remote station. If a camera disposed in *>0; 

a particular remote station is to be operated, it is necessary FIG. 5 shows one example of a display provided on a 
to set the state of display of a monitor so that a moving monitor screen according to the present embodiment; 
image obtained from the particular remote station can be ^ fig. 6 is a schematic block diagram showing the con- 
displayed on a monitor screen in a fixed manner. As a result, struction of a window switching control system; and 
it is impossible to utilize the merits of communications pjQ 7 shows the state of transition from one display 
among multiple points. m ode to another. 

SUMMARY OF THE INVENTION DETAILED DESCRIPTION OF THE 

It is, therefore, an object of the present invention to solve 5 ° PREFERRED EMBODIMENT 

the above-described problems. An embodiment of the present invention will be described 

Another object of the present invention is to provide a below with reference to the accompanying drawings, 
video conference system which makes it possible to easily FIG. 2 is a schematic block diagram of the arrangement 
operate a camera disposed in a remote station. 55 of a video conference terminal according to the embodiment 
To achieve the above objects, in accordance with one of the present invention. The arrangement shown in FIG. 2 
aspect of the present invention, there is provided a video includes a video camera 10 disposed in a station for picking 
conference system arranged to conduct a video conference up an image of a conference participant and others situated 
among multiple points by communicating at least images in this station (hereinafter referred to as "the present 
and sounds among the multiple points, which system com- 60 station"), a panhead part 11 for providing movement control 
prises display means for displaying moving images re spec- over the video camera 10 to cause it to perform various 
tively obtained from a plurality of connected stations on movements such as panning and tilting, a monitor 12 for 
individual window screens, station selecting means for visually displaying a picked-up image or images obtainable 
selectmg one station from among the plurality of connected from the present station and/or remote conference- 
stations which respectively correspond to the moving 65 participant stations, a loudspeaker 14, a microphone 16, and 
images displayed on the individual window screens of the an operating part 18 disposed in the present station for 
display means, and control means for enabling operating providing control operations, such as the operation of con- 
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trolling movements, such as panning, tilting and zooming, of which interconnects video conference terminals disposed at 

the video camaa 10 disposed in the present station as well multiple points and enables a video conference to be held 

as those of cameras disposed in the remote stations, and the among t he multiple points. 

operation of selecting a desired one from among the cam- FIG. 4 is a block diagram showing the internal construc- 

eras. In the present embodiment the operating part 18 is 5 Hon of the multiple-points interconnection control device 

displayed as a window on a display screen 12a of the «>. The multiple-points interconnection control device 69 

monitor 12, as will be described later. Ttie shown arrange- includes multiplexing/demultip lexing cirauts 70, 72 and 74 

ment also includes a selection control part 19 for selecting for multiplexing or demultiplexing ^formation (image 

a window corresponding to a transmitted video signal and sound and otters) to be transnntted, an image _ selecton 
causing the momtor 12 to visually display the transmitted to control part 76 for selecting daU to be diluted from 

video fignal in the selected, crnrejponmng window, as will movmg-jmage deceived bom ^j^c 

be described in detail late The selection control part 19 statlons - 8 sound «■« 78 **» «™* 

^ also to transmit a control signal supplied from the & <™ fi^FT^"* rfT 

operating pa, 18 to interconnection con- Jr JttSftSSt 

asaconmuterkeyboard^astm-imagemputdevice.agrapbic date sdccuon control part 80. 

input digitizer or a sub-monitor for displaying an image The multiple-points mtoconnectoon control device 60 
supplied ^rom another auxiliary device, and the body 22 of network interfaces 84 86 and 88 for connect- 
the video conference terminal whidi constitutes part of a 2D ing the device 60 shown in FIG. 4 to the communication 
video conference system. The present and remote stations network 58, and a communication control part 90 for con- 
are each provided with the arrangement shown in FIG. 2, trolling network access to each of the stations, 
and are capable of communicating with one another via a The operation of the present embodiment will be 
communication network 58. described below with reference to FIG. 5 which shows a 
FIG. 3 shows the details of the body 22. In the body 22 25 display ; example >of a. moving image acc^g tothe present 
shown to FIG. 3, a video interface 30 is provided for embodiment and FIG. 6 which shows the construction 
connection with the camera 10 and the monitor 12, and has contro1 . P 3 "- 

anrrnageprocesstogfunction.sutmasscreendlvision.image To start a video conference among multiple points, the 

combination and character combination. A video coding- respective stations located at the multiple points issue calls 

decoding circuit (CODEC) 32 is provided for coding a video ™ *<> «e multiple-points interconnection control device 60 (i.e., 

signal supplied from the video interface 30 or decoding i»ue instructions to connect the respective stations to the 

revived coded video information. video conference system), so that the multiple-points inter- 

_ , . , . . _„ , .. . . , ~„ ■ connection control device 60 provides connections among 

In the body 22 shown mHG 3 an audio onterface 34 is e points, thereby starting the video conference. At 

provided for connechoa with the loudspeaker 14 and the ^/^n m ' e ^ conference is started, a time- 

microphone 16, and has an audio processiiigtochonsuch m0 ving-irnage display mode (a first mode) is set in 

as an echo^ncel^g function. An audio cotog-decoding conf ereD ce lystel I the case of the time^ivision 

circuit (CODEC) 36 is provided for coding an audio signal ? before the multiple-points 

supplied from die audio mterface 34 or eroding reeved JSan control device 60 provides connections 

coded aucfao infc^Uon. Adelay c^cuit 38 is provided for ^ ^ b ^ ^ 

flaying audio mformation coded Jby e * co^ earned m me pr^seit station flayed m a^wmdow 13D 

decoding circuit 36 or received coded audio information by ^ & ^ ^ Qf ^ mo ^ or u ^ advance . At 

a predetenruned time penod. The delay circuit 38 serves to ^ ^ ^ ^ tive located at ^ multiple 

synchronize audio information with video informaUon. ^ ^ calls to ^ ^pie-points interconnection 

The body 22 also includes a computer 40 for providing a 45 contr ol device 60 so that the multiple-points interconnection 
video conference function and a computer conference control device 60 is connected to the stations, the multiple 
function, a still image/graphics control part 42 for control- m connected to one another, moving images trans- 
ling the still-image input/output and the graphic input/output from me respective connected stations are displayed 
of the auxiliary input/output device tenninal 20, a device w win dows 133 and 13C on the display screen 12a of 
control part 44 for executing control of each terminal device, 5Q memon i tor 12 which correspond to the respective connected 
and a data port 46 for executing data transfer to and data sta tions (in the present embodiment, remote stations A, B 
reception from the auxiliary input/output device terminal 20 ^ q ^ movin g images transmitted from the respective 
via the computer 40, the still image/graphics control part 42 stat ions immediately after the stations have been connected 
and the device control part 44. to mc mu ltiple-points interconnection control device 60 are 

The body 22 also includes an interconnection procedure 55 transmitted to the present station from the multiple-points 

control part 48 for controlling interconnections via the interconnection control device 60 in a time-division manner 

network 58, a network signal control part 50 for providing by the image selection control part 76 being switched by the 

control such as end/end control for establishing a common control part 82 shown in FIG. 4. If the present station and the 
mode which allows communication to be conducted among multiple-points interconnection control device 60 are con- 
video conference terrninals, and a communication control go nected by a line which does not have a large capacity, image 

part 52 for collectively controlling communication by means information from any one of the connected stations is 

of the interconnection procedure control part 48 and the transmitted to the present station at any time. Accordingly, 

network signal control part 50. while image information transmitted from one station is 

The body 22 includes a demultiplexmgr'multiplcxing cir- being displayed as a moving image, image information from 

cuit 54 for multiplex transmission of data, a network inter- 65 the remaining stations is displayed as still images. During 
face 56 for connection with the communication network 58, this time, the control part 82 shown in FIG. 4 sequentially 
and the multiple-points interconnection control device 60 switches the image selection control part 76 with the passage 
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of time, whereby the images received from the remote the time when a video conference among multiple points is 

stations A, B and C and displayed in the respective windows started, the first mode (time-division moving-image display 

13A, 13B and 13C are repeatedly switched between the state mode) is set, as described previously, and the time-division 

of a still image and the state of a moving image in sequence moving-image display mode, the speaker's station moving- 

with the passage of time. 5 imag e display mode and the selected station moving-image 

Another display mode is a speaker's station moving- display mode can be switched from one to another. In the 

image mode (a second mode) in which image information » case 0 f either of the time-division moving-image display 

transmitted from a station in which a speaking conference rao de and the speaker's station moving-image display mode, 

participant is situated is displayed as a moving image. In the only a yy^ camera disposed in the present station can be 

case of the speaker's station moving-image mode, if a 10 controlled, whereas, in the case of the selected station 

conference participant in an arbitrary station speaks, audio moving-image display mode, a video camera disposed in a 

information as well as video information are transmitted to desired station selected from among the present and remote 

the multiple-points interconnection control device 60. Audio stations can be controlled 

information demultiplexed by the multiplexing/ ^ is app^nt from the foregoing description, m acoor- 

denmlhpkxing circuit 70 (72 or 74) shown m FJG 4 „ „ ^^Zhopr^ntmb^Ztis^Mttoptovi^ 

inputted to foe sound mixer 78. Tic sound mixer 78 deter- g ^ ^Jrencz system which enables a conference 

mines which station has transmitted the audio information, situated m { particular ^ m among a plurality 

and on the baas of toedecmonoutputfromAe sound Bluer £ fc0J £ ected stat ionstoremotdy control a video camera and 

78 the control part 82 swrtches and controls the image ^ ^ ^ ^ M ^ &ta& ^ 

selecuon conttol part 7«. In otter words, each time * M ^ Qr a Icmote ^ ^ ^ obtained from 

conference participant in a remote station speaks, the stdl coanecteA stations being displayed in individual 

unagc displayed on a wmdow corresponding to the remote ^ Aows & ihe particuhx st&tiol 

station is switched to a moving image. is daim £l is: 

In each of the first and second modes, control, such as 1A coherence sy Stenl arranged to conduct a video 

panning, tilting, zooming and focusing, to be executed by 25 confercnce multiple interconnected stations having 

using a camera operating panel window 15 on the display camera by communicating at least images and sounds 

screen 12a shown in HG. 5 can only be applied to the video me mu ltk>le stations, comprising: 

camera 10 and the panhead part 11 which are disposed in the . ° , . ... . . . 

Dresent station (a) display means for displaying movmg unages respec- 

o^-i, , ■ * ■ • . . . . .. . tively obtained from the stations on individual win- 
Still another mode is a selected station moving-image 30 „_ . „„„„, , - . . „ _„_,,. 
,. , . ... . . . . ... . . f. , dows on a screen or said display means; 

display mode (third mode) in which a video camera disposed „ v , , , . u 
in a selected station can be controlled. Referring to FIG. 5, O) ^tion selectmg means for sdecting one station from 
in the case of the selected station moving-image display mc P*"** of staUo ^ bv sdectog one win- 
mode, any one of the windows 13A, 13B, 13C and 13D dow ^msaxd windows on the screen of said display 
which correspond to the remote stations A, B and C and the 35 means; and 

present station, displayed on the display screen 12a of the ( c ) control means for enabling operating control of a 

monitor 12, is selected by a conference participant by means camera disposed in the station selected by said station 

cf a pointing device such as a mouse or a touch pen. To selecting means. 

definitely inform the conference participant which the A video conference system according to claim 1, 

selected window is, the selected window is flashed as shown 40 wherein said display means is controlled to provide visible 

in FIG. 5, or the color of the frame of the selected window indication of the selected station. 

is changed, or a window 21 indicating which window 3 - A video conference system according to claim 1, 

corresponds to the selected station is separately provided. wherein said control means includes a control window 

This control is executed by the device control part 44. A displayed on the screen of said display means, 

signal indicative of the selected station is transmitted to the 45 4 - A video conference system according to claim 1, 

nmltiple-points interconnection control device 60 by the . wherein said display means is disposed at a selected one of 

selection control part 19, and the control part 82 (refer to said stations and separately displays an image obtained from 

FIG. 4) executes switching control of the image selection toe selected one station and images obtained from others of 

control part 76 in accordance with the signal. The multiple- sai d stations. 

points interconnection control device 60 causes the station in 50 5 * A video conference system according to claim 1 or 4, 

which the selection of the video camera 10 to be operated wherein said station selecting means includes a pointing 

has been performed to display, as a moving image, a window device for selecting the window on the screen of said display 

which corresponds to the selected remote station, i.e., the means. 

station in which the video camera 10 desired to be operated * • A video conference system arranged to conduct a video 

is disposed, irrespective of time or the presence or absence 55 conference among multiple interconnected stations having 

of speaking. During this state, the conference participant cameras by communicating at least images and sounds 

operates the icon of the camera operating panel window IS among the stations, comprising: 

by using the pointing device, to control the video camera 10 (a) display means for displaying images respectively 

and the panhead part 11 which are disposed in the selected obtained from said stations on individual screens; 

station. 60 (b) station selecting means for selecting one station from 

Any one of the first, second and third modes can be among said stations mode selecting means for selecting 

selected by selecting a desired icon from among icons 17a, a system operating mode from among a first mode in 

17b and 17c in a mode switching window 17 on the display which moving images respectively transmitted from 

screen 12a, and information indicative of icon selection is said stations are displayed by said display means in a 

processed by the device control part 44. FIG. 7 shows the 65 time-division manner, a second mode in which only an 

state of transition from one mode to another during the image transmitted from a station in which speaking is 

aforesaid mode switching process. As shown in FIG. 7, at occurring is displayed as a moving image, while 
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images transmitted from the others of said stations are rt>1 selecti™ m Mn ^ „i„^„ 

respectively displayed by said display means as stffl f^m^LT^ • sdeCtmg ° nCima 8e input device 

images, and a fcird mode in 3 onfran t^ol < , from , amo i n 8 said devices; and 

transmitted from a station selected by 2 ^Z^ll^l^ """"j* aS a device 

selecting means is displayed by said display means as < 6 6 , om a mode m which 

a moving image <uu mspjay means as 5 moving images respectively transmitted from the plu- 

7. A video conference system according to claim «, further SvL^f • *T ***** by Said 
comprising control means for executing operating control of 2 t P e " dlvlaon ^Mer and a second 
a camera to obtain an image mode m ^ an image transmitted from an image 

8. A video conference system according to claim 7 SL, 06 sdect ^ d ^ said sdcctill g means is dis- 
wherein when the third mode is selected by saidmode 10 to^^^T^ whllelma g« eoiresponding 
selecting means, a camera disposed in a station other thanl Llv « llT 86 mpUt deVK * 8 m reSpec " 
station in which said display means is disposed is control- 17 aI^F? 28 $bU Una ? es " 

lable by said control means ^ 1 17 ' . A contro1 ^vice according to claim 1«, further 

9. A video conference system according to claim 7 compnsmg conttol means for executing operating control of 
wherein when the first or second mode issdected by said " ."T d f lces to obtam me *■«■■»■ 

mode selecting means, a camera disposed in a station in Z ° ^ n °! system anranged *> be capable of 

which said display means is disposed is controllable by said co ™f?, a ^ conference among multiple intercon- 

control means. nected stations having cameras by communicating images 

lO-AcontroldevireforapluraUtyofimageinputdcvias ^ stati °ns. ^mprising: 

comprising: '20 W msplay means at one of said stations for displaying 

(a) display means for displaying moving images resoec- obtained fr 01 * said one station and others of 
tively obtained from said image input devices on mdi- sa w stations on wmdows on a so-een of said display 
vidual windows on a screen of said display means- m - wwdows corresponding individually with 

(b) selecting means for selecting one image input device JZZ?T'' , , . , 

from among said image input devices by selecting one 25 { ) fw sdect ively controlling said display 

window from said windows on the screen of said ^ * caus « said windows to display images 

display means; and obtamed from said one station and said other stations as 

(c) control means for controlling the image inpnt device moving images or still images. 

selected by said selecting means P 19 ' A ^em according to claim 18, wherein said control 

11 A control device according to claim 10 wherein said 30 TTa Mlec&v ^ ^ntrols said display means to cause one 

display means displays identftaraon 7te sSSnS l^t * ^ ^ said one 

input device on or me selected image station as a movmg image and to display the images 

1Z A control device according to claim 10, wherein said ob ^ff^ ^ ^ns as stm images, 
control means includes a control windWatolaved^n me system according to claim 18, wherein said control 

screen of said display means. * ' 33 means selectively controls said display means to cause one 

13. A control device according to claim 10, wherein said ^ft, 5 "^ t0 ** ta * B ° btained 60111 4 station 
selecting means includes a pointing device for leSgfce tf^ stf on as a moving image and to display 
window on the screen of said display means * the miagcs obtain^ from said one station as a still image. 

14. Acontrol device for aplundiry of image input devices JL m ""S^ ? ^ "» Wherein said 
comprising: gc input oevices, ^ means further provides a display of a control window for 

/.\ as. 1 , ,. . . said control means. 

/k\«~i~~*: ~ ' * , . operably responsive to sound issuing from a station to cause 

^frot^n^ -° r Sele£tmg0neimage 45 said display means to display the image obifrlsaS 

from among said image input devices; and station as a moving image 

^J^ 6 l eICCti118 meaDS f ° r Selectin « a dcvicc opc^g 21 A camera control system for controlling cameras of 
mode from among a first mode in which moving multiple interconnected stations, coinprising 

SeX^f ttTr^T^ ^ ^ (a) a fOT ^P^g moving images respectively 

while images'transmitted from others 35 Sd P 2ow fofT^ll T I**!*" 

inputdevices are respectively displayedby saiddilplfy 55 fc w n ZZw tv 

means as still images, and a third mode in which m 1,11 ^ i ?^ bkn8 , 0peratu, g contro1 <* a camera 

image fransmitted from an image input oeWce S^a <^d in the sl^ion selected by said station selector. 

by said selecting means is displayed aw S wh^J^T i' 0 ^ 01 T?? to daim 23 > 

image. movmg wherem said display is controlled to provide visible indica- 

15. A control device according to claim 14 further « bon . of 4 station 
comprising control means for execuLgopSng condor ffh L w ' ^ ^ Dg to daim 23 ' 

the image input devices to obtain the Lages wherein said controller inciudes a control window displayed 

l«.Aconn^ldevic*forapluraHtyof^einput devices 5 T^l^^?^ 
comprising: 6 v ' 26 - A camera control system according to claim 23, 
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27. A camera control system according to claim 23, 
wherein said station selector includes a printing device for 
selecting a window on the screen of said display. 

28. A camera control system according to claim 26, 
wherein said station selector includes a printing device for 5 
selecting a window on the screen of said display. 

29. A method for controlling a plurality of image input 
devices, comprising: 

(a) displaying moving images respectively obtained from 
said image input devices on individual windows on a 10 
screen of a display; 

(b) selecting one image input device from among said 
image input devices by selecting one window from said 
windows on the screen of said display; and 



10 



(c) controlling the selected image input device. 
30. A method for controlling cameras of multiple inter- 
connected stations, comprising: 

(a) displaying moving images respectively obtained from 
the stations on individual windows on a screen of a 
display; 

(b) selecting one station from among the plurality of 
stations by selecting one window from said windows 
on the screen of said display; and 

(c) enabling operating control of a camera disposed in the 
station selected. 

***** 
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